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[57] ABSTRACT 

A search facility having a user interface including three 
windows: a query window, a graph window and a history 
window. Each of the windows is presented simultaneously in 
the graphical user interface. The query window displays the 
text of the most recently input query statement which is 
searched in a database stored in a computer system. The 
graph window graphically displays the current results of the 
most recent query statement. The history window presents 
the query statements and their results during the current 
query session. In one preferred embodiment, the query 
statements and their results are graphically presented as a 
tree, wherein the query statements and query results are 
nodes and each query statement result is a child of the query 
statement which was run to create it. Input to any of the 
windows will change the presentation of data within the 
other two windows. 
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DATABASE SEARCH FACILITY HAVING It is another object of the invention to change the set of 

IMPROVED USER INTERFACE query statements by manipulating the graphical presentation 

of the query result. 

BACKGROUND OF THE INVENTION i t ^ another object of the invention to graphically repre- 
ss invention relates generally to computer stored data- 5 *"\ me ^tionship of the query statements and query 
bases. More particularly, it relates to a system, program and rcsults m a W h ™ 1 user intcrface - 
method for accessing a database utilizing a graphical user These and other objects are accomplished by a search 
interface facility having a user interface including three windows: a 

Computer stored databases have attracted an increasing 10 W ™ d ™' a and a ^ *? ndow - 

amount of interest, not only because of the rapid expansion of the wwdows is presented concurrenUy in the graphical 

in the data stored and retrieved by these databases, but also user ""efface. The query window displays the text of the 

as a result of the data relationships which can be established most recently input query statement which is searched in a 

during the storage or retrieval processes. With the growing database stored in a computer system The graph window 

prevalence of relational databases, the training and experi- 15 g^caUy displays the current results of the most recent 

ence of a typical end user has decreased as the available statement The history window presents the query 

resources have increased. Users of databases have been statements and their results dunng the current query session, 

particularly desirous of improvements in the graphical user In °f preferred embodiment, the query statements and the,r 

interfaces to control the database applications to make them results are graphically presented as a tree, wherein the query 

u„ f _j n ku u., ^ , • „ * statements and query results are nodes and each query 

understandable by the novice user. 70 , . . , . r 1 « - ■ 

. , r . • statement result is a child of the query statement which was 

One of the more difficult elements of problem solving searched to create it. 

when using a database is often the identification of the ¥ •.. . 

sources that cause a particular problem. Search statements or r In P ut to .^7 of u the v™* 3 ™ ™llchange : the presentation 

queries are usually used for searching information stored in of data w,thlD 1 «her two windows. Additional query 

a database in an organized fashion to help problem solving. 25 statements will change the graphical presentation of the 

When users have few clear ideas about how to construct the resulls the g™Ph window and add new nodes to the tree 

proper query for solving a problem, a common approach is P res f n,6d ,n the h,stor y . w,ndBW - By | man 'P u ' at ' n g^ the 

to start by examining an initial query report resulting from g ra P mcal P^^tion of the results in the graph wuidow, 

an initial query for more information. Based on this new « ™*Me<l ^ statements are generated and pre- 

information, the user then decides how to narrow the search, 30 * Dted m . ,h f W w ? nd ? w - w hich also add nodes to the 

or "drill down" further within the database. If these nar- b ^f window By selecting particular nodes m the tree m 

rowed searches do not produce the desired result, then the *» mstor y w ! ndow ' lhe ^ can retura t0 and mod ^ 

user must back up to a previous search statement and try Pf™ 08 V™** to construct new query statements. By 

. selecting the root node in the history window, the user can 

, . , ....... initiate a new query statement independent of any previous 

Current search techniques are cumbersome, inhibiting 35 tatemem ^ new or modified query stateme nts are 

efficient query formulation. Most existing systems do not ^ thM the fesults afe ^ m tfae h 

provide a query history. These systems make iterative prob- wind<w and new Qodes are created m tfae hist 
lem solving difficult by forcing the user to 1) remember all 

previous results, or 2) manually save or print the query and BRIEF DESCRIPTION OF THE DRAWINGS 

result. This is cumbersome. 40 

^ , . , , . „ j These and other features, advantages and objects will be 

Those systems that do provide a history usuaUy provide ^ ^ mdciSlood K t er l D(x t0 m J e following 

some sort of linear log. Many commercia^ y avadable data- descri tion ^ attached drawings . 

bases have a history command which allows the user to . . 

access this log. The information within the log is usually not . FI t G - 1 de P lcts . a coniputer system including system 

adequate. It may contain the number of "hits" which satisfy 45 d *P la y> s y stem umt > mouse and keyboard. 

a search particular set of statements. It may contain nothing FIG. 2 is an architectural block diagram of the computer 

more than the initial query. The problem with these system in FIG. 1. 

approaches are two fold. First, the log is presented in a linear FIGS. 3A-3D depict the graphical user interface of the 

way. This linear presentation does not reflect the actual search system. 

problem solving process, where one query may be refined to 50 piG. 4 depicts the data structures used to present the 

produce another. Second, there is no convenient way to graphical user interface depicted in FIGS. 3A-3D. 

access the log. Further, when invoked, the history command FIG 5A _ 5C are flow of the search process ^ 

removes both the detailed query statement and the detailed the usef manipulates the graph i ca i ^ interface depicted in 

results of the last query statement from the display. The user $\G$ 3A-3D 

must recall these details in the context of the limited 55 , . ' , . . . 

, . . ,. . . . A1 , FIG. 6 is the graphical user interf ace of the search system 

summary when altering his search strategy. Also, the only , t , L • * . w j- j * 

. , i . . . . . • , ■/ wherein the graph window presents a multimedia data 

method in most search systems to change a search is to write ctrpam 

additional query statements. 

SUMMARY OF THE INVENTION 60 

The invention may be run on a variety of computers or 
The present invention represents an improvement over collection of computers under a number of different oper- 
prior art database search systems. ating systems. The computer could be, for example, a 
It is therefore an object of the invention to present a query personal computer, a mini computer, mainframe computer or 
statement and a graphical representation of its result when 65 a computer running in a distributed network of other corn- 
searched in a database simultaneously in a graphical user puters. Although the specific choice of computer is limited 
interface. only by disk and disk storage requirements, computers in the 



stream. 
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IBM PS/2 (TM) series of computers could be used in the controller 29 provides the hardware interface for mouse 13, 

present invention. For additional information on IBM's PS/2 the video controller 30 is the hardware interface for the 

series of computers, the reader is referred to Technical display 14, and the audio controller 31 is the hardware 

Reference Manual Personal Systems/2 Model 50, 60 sys- interface for the speakers 15a and 15b. The speakers 15a and 

terns IBM Corporation, Part No. 68X2224 Order Number 5 lsb ma y 10 present audio objects to the user. An I/O 

S68X-2224 and Technical Reference Manual Personal controller 40 such as a Token Ring Adapter enables com- 

Systems/2 (Model 80) IBM Corporation Part No. 68X 2256 munication over a network 46 to other similarly configured 

Order Number S68X-2254. One operating system which an data processing systems. 

IBM PS/2 personal computer may run is IBM's OS/2 2.0 0ne of me preferred implementations of the present 

(TM). For more information on the IBM OS/2 2.0 Operating 10 invention is as a set of instructions in a code module resident 

System, the reader is referred to OS/2 2.0 Technical Library, ™ the random access memor y 24 Umn rec » uired °y the 

Programming Guide Vol. 1, 2, 3 Version 2.00 Order Nos. computer system, the set of instructions may be stored in 

10G6261 10G6495 10G6494 another computer memory, for example, in the hard disk 

j . ' i . * \ t . . 4 . . drive 26, in an optical disk for eventual use in the CD ROM 

In the alternative, the computer system might be in the « j- i r ♦ i . fl 

tm . „ ,ln^ m/r r . i_- i_ 1C 32 or in a floppy disk for eventual use m the floppy disk 

IBM RISC System/6000 (TM) line of computers which run 35 , . A c . a . rt ^ n , 

* - /ryn r\ r ' ™ . jit drive 27. As shown in the figure, the operating system 50 and 

on the AIX (TM) operating system. The various models or . m -j . ■ n *w n i 

mon o . j i_ j • ur presentation manager 52 are resident in RAM 24. In this 

the RISC System/6000 are described in many publications r i • ljj- i. * 

r mw • r i nrr^ / /^nrtrt example, the invention is embodied in a search system 54 

of the IBM Corporation, for example, RISC System/6000, ,. * , , t , - c , .... 

7073 and 7016 POWERstation and POWERserver Hard- wh ' ch S6arches » , database 56 and "t'^s the operaUng 

ware Technical reference, Order No. SA23-2644-00. The 20 ^ ° r presen.aUon manager to present the GUI. Some 

A¥V j -lj-^ • operating systems such as OS/2 have an embedded presen- 

AIX operating system is described in General Conceipts ana .\. ° J t , . r 

d j 7rvi/ ,/ n/ci- c * i£r\nr\r\A kt tation manager. Other systems use a presentation manager 

Procedure— AIX Version 3 for RISC System /6000 Order No. . t_- . j i • r j Al , . f. 

c/ ™ nnnn ^ it . ■ ur *• f to iv if which is a stand alone piece of code. Alternatively, the 

SC23-2202 — 00 as well as other publications of the IBM . . i j £ • i . a * . -i i 

r . r present invention could be implemented m a stand alone 

^ 1 25 application which has its own graphical user interface. 

In FIG. 1 a computer 10 comprising a system unit ll^a Qu statements which are ^ t0 relrieve m f 0 rmaUon 

keyboard 12, a mouse 13 and a display 14 are depicted. The from databases ^ well known lo the arL For exara p le , the 

screen 16 of display device 14 is used to present the ANSl standard Stmcture Unguage (SQL) is one 

graphical user interface (GUI). The graphical user interface { fof osi such statements. A query will define 

supported by the operating system allows the user to use a m u{Gr reC ognizable terms, the tables' in which the data 

point and shoot method of input, i.e., by moving the mouse ^ be fouQdj lfae {Mq& columns of 

interest, the conditions 

pomteristoaniconrepresenungadataobjectataparucular f0WS musl Mtisfy the order of distinctiveness 

location on the screen 16 and pressing one of the mouse CODStraintSj connections of data within tables and other 

buttons to perform a user command or selection. relationships. The reader is referred to a text describing SQL 

FIG. 2 shows a block diagram of the components of the 35 a nd its uses in IBM Operatina Systems/2 Extended Edition 

personal computer shown in FIG. 1. The system unit 11 Database Manaaer Structured Query Language (SQL) con- 

includes a system bus or plurality of system buses 21 to cep ts booklet published by the IBM Corporation in 1991. 

which various components are coupled and by which com- When a ^ ^ provided to tie the query statement, its 

munication between the various components is report or results and the query history together, the user can 

accomplished, The microprocessor 22 is connected to the ^ interactively see a query result, manipulate a query result to 

system bus 21 and is supported by read only memory (ROM) gen erate predicates to be added to the next query statement, 

23 and random access memory (RAM) 24 also connected to mo dify the updated query statement, and see the next query 

system bus 21. A microprocessor in the IBM multimedia result after the new query statemerjt is modified and 

PS/2 series of computers is one of the Intel family of executed. Further, a logging facility records the interactive 

microprocessors including the 386 or 486 microprocessors. 45 act ivities a user has performed on the linked query 

However, other microprocessors including, but not limited statement, query result, and query history in a problem 

to, Motorola's family of microprocessors such as the 68000, solving session and presents the query history in the history 

68020 or the 68030 microprocessors and various Reduced window. Users are then allowed to use the logging facility 

Instruction Set Computer (RISC) microprocessors manufac- t0 g0 back t0 any query statement or result, and then 

tured by IBM, Hewlett Packard, Sun, Intel, Motorola and 5Q con figure this iterative problem solving process. The search 

others may be used in the specific computer. system of the present invention provides a more effective 

The ROM 23 contains among other code the Basic way for iterative problem solving than any previous method 

Input-Output system (BIOS) which controls basic hardware because a clear record of past activity is actively maintained 

operations such as the interaction and the disk drives and the and is readily available concurrently with the most recent 

keyboard. The RAM 24 is the main memory into which the 55 query statement and result. Also, a trial and error problem 

operating system and application programs are loaded. TTie solving session can be saved and edited to produce plans for 

memory management chip 25 is connected to the system bus future use, which greatly increases the value of this problem 

21 and controls direct memory access operations including, solving approach. 

passing data between the RAM 24 and hard disk drive 26 As shown in FIGS. 3A-3D, the graphical user interface 

and floppy disk drive 27. The CD ROM 32, also coupled to 60 (GUI) invention is implemented using three windows. The 

the system bus 21, is used to store a large amount of data, query window 101 contains the most recent query statement 

e.g., a multimedia program or large database. m the current query. In this case, SQL is used as the query 

Also connected to this system bus 21 are various I/O language, but those skilled in the art would appreciate that 

controllers: The keyboard controller 28, the mouse control- other languages could be easily substituted. The graph 

ler 29, the video controller 30, and the audio controller 31. 65 window 102 shows the results of the query statement 

As might be expected, the keyboard controller 28 provides displayed in the query window in a graphical representation, 

the hardware interface for the keyboard 12, the mouse In this case, bar charts are used, but the user is free to choose 
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the type of graphical presentation, which could be a line Referring to the bar graph 112, he sees that sales were 
chart, a pie chart, a bar chart, a graph, or other representa- generally poor, but were good in a small price range. He 
tion. The third window is the history window 103. In the marks an area 120 on the X-axis 121 which corresponds to 
preferred embodiment of the invention, the history of the the unit price where he sees the peak in sales. In response to 
query is presented as a graphic representation resembling a 5 lne sales manager's manipulation of the graph window 102, 
tree in which all of the query statements and their results are referring now to FIG. 3C, the query window 101 is auto- 
portrayed as nodes. matically updated. The user is automatically moved back to 
The windows are all related. Modifying the query state- lhe query window 101. A pointer 134 to the modified query 
ment results in changes in the graph window to reflect the 130 ^ stored ^ a node ^ tne tree m 
new results for the modified query statement i.e., the query 10 Proceedin t0 na 3D> the modified ^ executed 
results, similarly by directly manipulating . the graph, the and a Qew Qode 135 ^ ^ tQ ^ ^ m 
user can modify the query statement as well. For example, . , ■ . 
selecting a subset of a parameter scaled along the x-axis ™ e "f" m *\™° l ™ e ^Z^u^™ ^ ^ 
could result in further restrictions in the SQL WHERE fP h 101 ' '° f 11 down 10 more detailed 
clause. Tlie history window, which is a graphic depiction of 15 data ' or tree A 08 , t0 ^ck up to some prevrcus query 
a log, records the activity of the user in both the query and state , menl - ™ e ° f each ° f l , he W statements and 
graph windows. Each query statement or graphed result is ^ * ««ted and kept in the log and presented .n the 
Represented as a node in the tree. Agraphed result is the child wmdow 1 1( * ««* " ' tbe ma ° ner m 

of the query statement that was run to create it. A modified W result should be P k resented " n ^ 0 m ' t ' a ! ed b \ 

7* ,v *u„ n c t u a <v™ selecting a menu item from the action bar 138. Additional 

query statement is the child of the query statement trom 7n . . , „ 

which it was created. Graphically presenting such a progress nod <* * 40 > U } r *P' ese J£ the m0 , st deta,led <> ue 7 X f and 

record allows the user to quickly find previously created * sul « }«• ^ . results P^med m the graph 

..v tl Jt u rj* wmdow 102 could be used in a multimedia presentation that 

query statements, which greatly speeds the process of data -7: * . , , . * . . 

analysis ^ supports the wide and detailed views of the data. 

Many well known graphic user interfaces support a notion 25 u S*™* ^ si ™ ctu ™ mus \ bQ s l° red * **** to 

of "selecting". To select an object in the GUI, a user puts a lbe }{ 6& ? 1Ct * d lD the P reoedul 8 ^ res * sh ™ 1Q 

mouse pointer over an object on the screen which may be a 4 > resident m the ^ 24 15 a data structure 2 ^ w ^ ch 

window on the screen, or in the case of the present invention, mclude r s root node 201 f d s ^ eral cluld nodes 2 « 2 -205. 

a node of a tree, or a bar on a bar graph. The operating Each of * he chlld nodes 202 - 2 ° 5 correspond to one of the 

system keeps track of the relative position of the objects 30 ^ 210 > 214 or r ^ lts 212 ' 216 ob J ects - Morc nodes are 

within the GUI and the mouse pointer as it is manipulated by added to tne trce 200 45 me mcT continues his search, 

the user. The user then presses the appropriate mouse button creating more 1 uer y statement and result objects, 

to select the object. The object is then presented with The root object 201 is the root of the tree structure and is 

"selected emphasis" by the window manager, which means also a node > whicn w* 11 be t0 slorc tne graphs (results) 

that the object is visually set apart from other objects, such 35 and <l uer y statements mat the user creates. The NODE 

as inverting the pels around a selected object or changing the objects 202-205 are data structures containing a particular 

color of the border in a selected window. This selection node in the tree. Nodes can correspond to results or query 

process is commonly referred to as "clicking on" an object. statement. Nodes also contain a list of children, which are 

FIGS. 3A-3D depict the graphical user interface 100 of also nodes - ^ Dode ob J ects delude several variables 

the searching system of the present invention as it would be 40 includin S : NODE_QUERY, a pointer to the query object; it 

presented on the system display. In this illustrative example, 15 nul1 lf this node is a S ra P h - NODE_GRAPH, which is a 

a manager in compact disc (CD) sales for a chain of music P omter t0 the S ra P h ob J ect i 11 1S Qul1 lf lhls node 1S a &*P h - 

stores needs to find the optimal price for a CD. He first, CHILD_LIST, which contains a pointer to the first of a list 

clicks on the query window 101 and is prompted for the lhat m children of this node. Subsequent children can be 

name of the query statement. He chooses the system default, 45 found ^ traversm S the NEXT_SIBUNG list. NEXT__ 

Queryl, 104 which includes search statements for price and SIBLING which contains a pointer to the next in a list of 

store location. He fills in the query parameters to find out siblin gs. The last sibling in the list will point to NULL. The 

how many units have sold at a high price (>$20) at a V mni node P 0 " 1 * t0 the 6x51 child with the variable 

particular store. He runs this query statement and asks for CHILD_LIST above. 

the results 105 in bar graph 105 form by selecting an icon or 50 QUERY Objects 210, 214 are data structures containing 

menu item for a bar graph result or other known selection all the elements that make up a query statement. The 

procedure. The query statement and its graphed results are QUERY_NAME variable contains the name of the query 

represented as nodes 106, 107 in the tree 108. Although the statement. QUERY_B UFFER variable contains all of the 

figures show the nodes presented as alphanumeric text or daU that make up the internal representation of the 

characters, icons or other symbols could be used. He sees in 55 query. The HAS_BEEN_RUN variable is a boolian flag 

the graph window 102 that the sales at this price and store that is set to true if the query has been run. 

were poor. He abandons this query. He clicks on the history The result objects 212, 216 are data structures containing 

window 103 and then clicks on the root node 109 of the tree all elements that make up a result and its graphical repre- 

108 to start over. The GUI at this point in time is shown in sentation. The GRAPH_TYPE variable is the type of graph, 

FIG. 3A. 60 e.g., bar, line, pie, etc.). The GRAPH_BUFFER variable 

Referring now to FIG. 3B, he types a new query statement contains all of the text and data that make up the internal 

110, Query2, for the total sales at another store with no representation of the graph. The PARENT__NODE is the 

restriction on price in the query window 101. He runs the query that was run to create this graph. If this graph is 

query, 110 and, produces a bar graph 112 in the graph modified, then the resulting query will be stored as a child 

window 103. Query2, 110 and its results 112 are shown in 65 of this node. 

the history window 103 as nodes 114, 115 in the tree 118. Several other variables are used to keep track of the user's 

The GUI 100 at this point is shown in FIG. 3B. progress in the search. THIS_QUERY: QUERY variable is 
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used to contain the name of the query with which the user returns to step 322 to wait for new user input. If the user 

is working. THIS__GRAPH: GRAPH variable is used to action is to open a node, in step 332, the system determines 

contain the most recently stored result. The CURRENT_ whether the node type is a query node or a result (graph) 

NODE: NODE variable is used to keep track of the user's node. If the node is a query node in step 334, the query name 

position in the tree. 5 ^ retrieved from the selected node and this name is assigned 

A process flow as the user manipulates the search system to the CURRENT_NODE variable. Next, in step 336, a test 

is illustrated in FIGS. 5A-5C. In step 300, the three win- ^ performed to determine whether the query statement has 

dows are initialized and the current node is set to the root been ^ before. If so, in step 338, the results from the query 

node in the tree structure. Next, the system waits for the first statement are retrieved. The results, as discussed above, are 

query statement from the user. When it receives the query 10 ^ a child node of ^ query sta tement or current node. These 

statement in step 302, it creates the first query object and sets results m displayed m a g^t, window in step 340. If the 

the query statement in the QUERY_BUFFER variable. query has not 5een ^ or once me results have 5een 

Next, in step 304, the user is given the option of naming the displayed in a graph window, the process returns to step 310 

query statement. The query name chosen is entered in the in which the query is displayed in the query window. 

QUERY NAME variable. Alternatively, a system default 1<; Tf .. , , - t u , w 

. — , . , . t . 15 If the opened node in the tree is a result node, the result 

naming mecha^m may be used to name the ^object. naine fa re £ e ved and assigned and the CURRENT_NODE 

Next, in step 306 the query object is stored as a child of the vaiiMf . ^ , o ^ * ^ ^ Iq ^ 

current node, which m this case is the root node. Next, in , . t t 4 r t , r c t , 
. mo ,u VimncMT nt^c • ui • rare corresponding query statement, the parent node of the cur- 
step 308, the CURRENT__NODE variable is set to THIS_ . w j • * ■ j r .u .r.u 
vi^r, -.1 . • . • ~T T rent result node is retrieved from the parent of the 
NODE vanable which is the current query statement. Next, ~ n rnnnrxrr x T ^r\T- * li i . X. 

t , • *? . * « . • 20 CURRENT__NODE vanable. In step 346, the query state- 
in step 310, the query statement is displayed in the query A . , , . t , . *, ' *: , 
window m lS dls P' a yed m tne Q uerv window. At this pomt, the 

. e . process proceeds to step 360 in FIG. 5C. 

At this point, the computer waits for the next user input. iri „ . _ , . 

In step 312, the computer receives this input, and in step 314, u If the "*» m P u \ 10 ° f ™ G ' 5 * K to ' ™ n . . qUCry> 

it categorizes the input. One of the possibilities is that the ^ the process as dep.cted ui FIG 5C a performed. First, instep 

user modifies the first query statement to write a second 35 °> a narae ° f n ^ "J?™^,^ MCr 'T' 

query statement which will require creation of its own query and f ss |» ,ed |° lhe ™IS GRAPH variable Alternately, 

object. In step 316, the QUERY_BUFFER variable of the a defau 7 U ™chamsm may be used to assign the result node 

second query object is set to the new query statement written name : In ^P 352 ' ,he l W e of a 8 ra f 1 nl f 1 r 'P r ^° tat ™ °j 

by the user. The process returns to step 306 where the new 30 the .<?f ired bv tbe input and the GRAPH_TYPE 

querystatementisstoredasachildof the current node which vanable 18 ass >g ned [ !° ,he u ^ r ™ e graph name and 

is the first query statement. A second alternative is to run the ««* are stored within an object which is the child of the 

query which is shown in FIG. SC. If the user action in steps lD S * P 354 N * t ? P f J 

312 and 314 is a request to display the tree via a mouse click ^ R ®^ 0I ? E J' n * 1 ? 15 t0 ' he °° of 'n" 

on the history window, the process proceeds to step 318 35 ™S-NODE variable which K the result node In step 360, 

where the search history is retrieved from storage. In step the [ esu te of ,he ^ *»*™* are displayed m the 

320, the tree, which is the graphical representation of the S ra P hlcal representation chosen by the user in the graph 

search history, is displayed in the history window. wm ow ' 

At this point, the search system waits for the next user There are many existing methods of graphing the results 

input. In step 322, it receives the input. Proceeding to FIG. 40 which satisf y the ^tions of the query statement. For 

5B, the system determines the type of input the user made, example, commercially available spreadsheets take results 

step 324. If the user has requested to edit the tree, in step and S ra P h lhem 10 a bar » hne > or P ie cha *> usm g a le S end and 

326, the user may delete branches of the tree or rename a value First, the system looks at all of the columns in the 

nodes and queries or graphed results. After a successful spreadsheet and uses the first text field as a legend and the 

search has been done, it is important for others to understand 45 fi L ret ™™T° nM * ^ &S the t value , for this text fi J eld t If 

the process that produced the desired results. Tne log can be mese fields are not appropriate, the application provides the 

used for that purpose. The tree can be pruned to more easily user wth a window to type in new legends or choose a new 

input the successful search. For example, nodes in which column to ovemde these defaults. 

typographical errors were made should be deleted to clean Next » me computer system waits for the next user action, 

up the log, so that it can be easily understood by others. To 50 Id ste P 362 > ^ next US&T aclion k received and is evaluated 

delete a node, the user clicks on the node. The node is m sle P 364 - The user input may be a request to modify the 

marked. The user then specifies a delete instruction from an g ra P n which will result in a modified query statement. In 

action bar menu, or from some other means. This node, and ste P 366 > me xlseT marks an area of the graph window and in 

all of its children are deleted. This is accomplished by ste P 368 > tne q uerv statement is updated as a result of the 

removing the selected node from the selected node's imme- 55 marked area * The resulting new query is stored as a child of 

diate parent. It may also be beneficial to rename query, tne current node in step 306 of FIG. 5A. 

graph, or result nodes with names that are more descriptive. The selection of and marking a portion of the graphical 

This can be accomplished in a similar, manner. By clicking representation of the results in the graph window can be 

on a node, the node is marked. The user can then specify a accomplished in a number of different ways depending in the 

rename instruction from a menu item of an action bar or 60 nature of the graphical representation, 

some other means. The user is then free to type in a new text If the graphical presentation of results is presented lin- 

string followed by the enter key. This text string will become early with respect to one of the search parameters, the query 

the new name for the node. Once all the changes have been statement with respect to that search parameter can be 

input, the tree is updated in disk storage with the user altered according to the teachings of copending, commonly 

changes and the process returns to step 318. 65 assigned patent application entitled "Graphical Definition of 

if the user's action is to select a node in a tree, in step 330, Range in the Selection of Data From a Database Field" to S. 

the node is shown with a selective emphasis. The process G. Li et al, Ser. No. 07/983,095, filed Nov. 24 1992 and 
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hereby incorporated by reference. For example, positions work well within the framework of this invention. IBM's 

along the axis which represents the search parameter in a bar Query By Example (QBE) is one example of another query 

graph are denned by a plurality of tacks. Each tack position language which would work well within this context, 

corresponds to a value for the search parameter. By marking Further, the graphical representation is not limited to a 

a field between two tack positions, the user can modify an 5 business graph. In fact, it is easy to store pictorial data in a 

SQL between statement to correspond to the values which relational database. Many relational database managers store 

fall between the corresponding search parameter values. pictorial information into a file. Within the relational dala- 

. . . . i_- r- » • base table which contains a reference to the pictorial 

For a pie chart or a bar chart, each piece of pie or each bar mformatioilf a oimer or offset int0 me file fa stored within 

displays information belonging to a certain category or the relational database. This method can also be used to store 

range of search parameters. By selecting, i.e, marking, one 10 additional types of mull j me dia data, such as sound 

or more pie pieces or bars, the query statement could be information, e.g., the relational database table can contain 

altered to search for data which satisfy the selected catego- me tit i e and ^ck number on an ordinary music compact 

ries or ranges. If the results are presented in a line or scatter disk, 

chart in two or three dimensions, a rectangle or cube may be ^ depicted in FIG. 6, a film archival system which when 
drawn around regions of interest. Each of the edges of the is s^ched will display results in full motion video is an ideal 
rectangle or cube would correspond to the upper or lower application. Using the query statement to select a list of 
value in a range of values of search parameters graphed frames and the graph window 401 to present the results, this 
along a particular axis. The SQL between clause for a solution can effectively be used to find clips within a 
plurality of query parameters can be modified to correspond database of video. One relational database table could con- 
to the selection range of values as in the above referenced 20 tain records which each have 1) a movie or selection name, 
application. Since at least one of the graphed parameters 2) the name of the file that contains the movie, 3) a frame 
must be a result rather than a search parameter, the selection identifier that contains the offset within the file of the frame 
by means of a box or cube can also mean not to present ™ question, 4) a time stamp for synchronization purposes 
results which occur outside the selected range. ( the frame fe displayed at this time stamp). The query 
w ,. t ., t t t t , 25 statement 403 in the query window 405^ could read: 
Modifying the query statement .to produce a new query S£LECT FRAM£S VoMmovie_table, WHERE 
statement according to manipulation of the graphed results tjme^oOiOO and time<l:00:30 and MOVIE-"Terminator 
of the query statement is taught in greater detail in com- y ^ ORDERBYTIME; This query statement 403 would 
monly assigned, copending application Ser. No. 08/072,618 dis { the 3Q seconds of video 406 within the graph 
and now U.S. Pat No. 5,608,899 entitled "Method and y/Maw m which gatisfy the query statement To make 
Apparatus for searching a Database" filed on the same date through the f rame s effective, rewind, fast forward, 
as the present application which is hereby incorporated by plaVj and singk step buUoQS m cou]d be presented and 
reference. used - n lbe usua ] wav Th e history window 409, as before, 
Alternatively, the user input in steps 362 and 364 may be wou j d prov ide a convenient means of understanding the 
to display the query statement or a mouse click on a query ^ previously viewed film clips and the query statements used 
window. In step 370, the screen focus is set to the query t 0 display them. 

window. Alternatively, the user may wish to display the tree While the mvention has been described with respect to 

in the tree window, in which case, the process returns to step particular embodiments above, it will be understood by 

318 in FIG. 5 A. mose s^Ued i n the art that modifications may be made 

If there are too many nodes to be presented within the ^ without departing from the spirit and scope of the present 

display space allotted to the history window, the user may invention. These embodiments are for purposes of example 

scroll back to prior nodes via scroll bars attached to the and illustration only and are not to be taken to limit the scope 

edges of the windows. An alternative embodiment of the 0 f lne invention narrower than the scope of the appended 

invention, could display the query statement and its result claims, 

with a single symbol to save display space. If the symbol is 45 \y e claim: 

selected, an exploded version of the symbol is presented in i, a method of searching a database stored on a computer 

which both the query statement and result are visible and system having a display, comprising the steps of: 

selectable. While the operating system can theoretically concurrently displaying, in respective first, second and 

handle infinitely large presentations through the use of the ^^d windows of the display: 

scroll bars, with a large tree and a small history window, the 5Q a query statement; 

search system will be less effective in summarizing the a first ^ D f results fr 0 ' m a database search of the first 

query history. However, it will still be better than the prior query statement; 

art systems. a symbolic representation of one or more query state - 

One alternative embodiment would allow the user to ments entered during a current query session involv- 

scroll the query or graph windows to concurrently show the 55 i n g multiple queries including the first query state - 

associated query statements and results. This provides an ment; and 

excellent means to gain a more detailed understanding of the linking the respective first, second and third windows 

summary of the query as presented within the tree. As the such that alteration of given information in one of the 

query statement and its results are linked together as parent windows alters the display of information in at least 

and child objects, input to the scroll bars could be another 60 one Q f me omer windows, wherein the linking step 

entry to the process described above in connection with includes the steps of 

FIGS. 5A-5C. marking a section of the first set of results in response 

As the scrolling or other manipulations takes place, the to user input; 

current node in the tree could be emphasized each time the creating a second query statement according to the first 

presentation in the history window is refreshed. 65 query statement and the marked section; 

As mentioned above, the search system is not limited to displaying a second set of results from a database 

the SQL query. There are several query languages that would search of the second query statement; and 
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modifying the symbolic representation to include a 
representation of the second query statement. 

2. The method as recited in claim 1 wherein the symbolic 
representation is a tree structure including one or more 
nodes, the first query statement displayed as a parent node 5 
in the tree structure and the first set of results displayed as 

a child node of the parent node. 

3. The method as recited in claim 2 wherein the linking 
step comprises the steps of: 

selecting a node in the tree structure in response to user 10 
input; 

presenting a second query statement represented by the 

selected node; and 
displaying a set of results from searching the second 

query statement represented by the selected node. 

4. The method as recited in claim 3 wherein the linking 
step further comprises the steps of: 

modifying the second query statement in response to user 
input to create a third query statement; 

displaying the third query statement; 

displaying a third set of results from a database search of 
the third query statement; and 

modifying the tree structure to include a node correspond- 
ing to the third query statement and to include a node 25 
corresponding to the third set of results. 

5. The method as recited in claim 2 wherein the linking 
step comprises the step of: 

deleting at least one node in the tree structure representing 
an unsuccessful query statement. 30 

6. The method as recited in claim 1 

wherein the symbolic representation includes a first sym- 
bol representative of both the first query statement and 
the first set of results and the linking steps includes the 
steps of: 

selecting the first symbol; and 

displaying an exploded version of the first symbol in 
which both the first query statement and the first set of 
results are separately displayed and selectable. ^ 

7. A computer program product in a computer readable 
memory for controlling a processor to search a database 
stored on a computer system, the product comprising: 

means for concurrently displaying, in respective first, 
second and third windows of a display of the computer 45 
system: 

a first query statement; 

a first set of results from a database search of the first 

query statement; and 
a symbolic representation of one or more query state- 50 

ments entered during a current query session involving 

multiple queries including the first query statement; 

and; 

means for linking the respective first, second and third 
windows such that alteration of given information in 55 
one of the windows alters the display of information in 
at least one of the other windows, wherein the means 
for linking comprises: 

means for marking a section of the first set of results in 
response to user input; 

means for creating a second query statement according to 
the first query statement and the marked section; 

means for displaying a second set of results from a 
database search of the second query statement; and 65 

means for modifying the symbolic representation to 
include a representation of the second query statement. 
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8. The product as recited in claim 7 wherein the symbolic 
representation is a tree structure including one or more 
nodes, the first query statement displayed as a parent node 
in tree structure and the first set of results displayed as a 
child node of the parent node. 

9. The product as recited in claim 8 wherein the linking 
means comprises: 

means for selecting a node in the tree structure in response 
to user input; 

means for presenting a second query statement repre- 
sented by the selected node; and 

means displaying a set of results from searching the 
second query statement represented by the selected. 

10. The product as recited in claim 9 wherein the linking 
means further comprises: 

means for modifying the second query statement in 
response to user input to create a third query statement; 

means for displaying the third query statement; 

means displaying a third set of results from a database 
search of the third query statement; and 

means for modifying the tree structure to include a node 
corresponding to the third query statement and to 
include a node corresponding to the third set of results. 

11. The product as recited in claim 8 wherein the linking 
means comprises: 

means for deleting a node in the tree structure represent- 
ing an unsuccessful query statement; and 

means for automatically deleting any child nodes of the 
deleted node. 

12. The product as recited in claim 7 wherein the first and 
second windows are concurrently scrolled to respectively 
display query statements and corresponding sets of results 
summarized in reports. 

13. A system including processor, memory, display and 
input device for searching a computer stored database, 
comprising: 

means for concurrently displaying, in respective first, 
second and third windows of a display of the computer 
system: 

a first query statement; 

first set of results from a database search of the first query 
statement; and 

a symbolic representation of one or more query state- 
ments entered during a current query session involving 
multiple queries including the first query statement; 
and; 

means for linking the respective first, second and third 
windows such that alteration of given information in one of 
the windows alters the display of information in at least one 
of the other windows, wherein the means for linking com- 
prises: 

means for marking a section of the first set of results in 

response to user input; 
means for creating a second query statement according to 

the first query statement and the marked section; 
means for displaying a second set of results from a 

database search of the second query statement; and 
means for modifying the symbolic representation to 

include a representation of the second query statement 

and a representation of the second set of results. 

14. The system as recited in claim 13 wherein the sym- 
bolic representation is a tree structure including one or more 
nodes, the first query statement displayed as a parent node 
in the tree structure and the first set of results displayed as 
a child node of the parent node. 
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15. The system as recited in claim 14 wherein the linking 
means comprises: 

means for selecting a node in the tree structure in response 
to user input; 

means for presenting a second query statement repre- 
sented by the selected node; and 

means for displaying a set of results from searching the 
second query statement represented by the selected 
node. 

16. The system as recited in claim 15 wherein the linking 
means further comprises: 

means for modifying the second query statement in 
response to user input to create a third query statement; 

means for displaying the third query statement; is 

means for searching the database according to the third 
query statement and displaying a third set of results 
from a database search of the third query statement; and 

means for modifying the tree structure to include a node 
corresponding to the third query statement and to 20 
include a node corresponding to the third set of results. 

17. The system as recited in claim 14 wherein the linking 
means comprises: 

means for changing a symbol in the tree structure repre- 25 
senting a node to be more descriptive of the node. 

18. The system as recited in claim 13 wherein scroll bars 
are provided to display query statements outside a current 
display space in the third window. 

19. A method of editing a database of stored video data 3Q 
stored on a computer system having a display, comprising 
the steps of: 

opening on the display a query window, a history window 
and a video window; 

searching for a first segment of video data in response to 35 
the user input of a first query statement, the first query 
statement displayed in the query window; 

displaying a symbolic representation including a first 
symbol representative of the first query statement in the 
history window; 

displaying the first segment in the video window; and 

linking the respective query, history and video windows 
such that alteration of given information in one of the 
windows alters the display of information in at least 45 
one of the other windows, wherein the linking step 
includes the steps of; 

taking a given action in response to user input in the 

video window; 
creating a second query statement according to the first 5Q 

query statement and the given action; 
displaying a second video segment from a database 

search of the second query statement; and 
modifying the symbolic representation to include a 

representation of the second query statement. 55 

20. A video data editing system including processor, 
memory, display and input device, comprising: 



40 



means for opening on the display a query window, a 

history window and a video window; 
means for searching for a first segment of video data in 

response to the user input of a first query statement, the 

first query statement displayed in the query window; 
means for displaying a symbolic representation including 

a first symbol representative of the first query statement 

in the history window; 
means for displaying the first segment in the video 

window; and 

means for finking the respective query, history and video 
windows such that alteration of given information in 
one of the windows alters the display of information in 
at least one of the other windows, wherein the means 
for linking step comprises: 

means responsive to user input causing a given action 
in the video window for creating a second query 
statement according to the first query statement and 
the given action; 

means for displaying a second video segment from a 
database search of the second query statement; and 

means for modifying the symbolic representation to 
include a representation of the second query state- 
ment. 

21. A computer program product on a computer readable 
memory executable by a computer system for editing stored 
video data, comprising: 
means for opening on the display a query window, a 

history window and a video window; 
means for searching for a first segment of video data in a 

computer memory in response to the user input of a first 

query statement, the first query statement displayed in 

the query window; 
means for displaying a symbolic representation including 

a first symbol representative of the first query statement 

in the history window; 
means for displaying the first segment in the video 

window on the display; and 
means for linking the respective query, history and video 

windows such that alteration of given information in 

one of the windows alters the display of information in 

at least one of the other windows, wherein the means 

for linking step comprises: 

means responsive to user input causing a given action 
in the video window for creating a second query 
statement according to the first query statement and 
the given action; 

means for displaying a second video segment from a 
database search of the second query statement; and 

means for modifying the symbolic representation to 
include a representation of the second query state- 
ment. 
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It is certified that error appears in the above-identified patent and that said Letters Patent ± s 
hereby corrected as shown below: 

In Claim 8, Line 4, after "in" insert -the- 

In Claim 9, Line 13, after "selected" insert -node- 

In Claim 13, Line 42, insert -a- before "first" 
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